Student Knowledge Diagnosis Using Item Response Theory and Constraint-Based Modeling
نویسندگان
چکیده
One of the most popular student modeling techniques currently available is Constraint Based Modeling (CBM), which is based on Ohlsson's theory of learning from performance errors. It focuses on the domain principles to correct faulty knowledge and assumes that a student will reach a correct solution without violating these fundamental domain concepts. However, even though this is a powerful and computationally simple technique, most student models of CBM-based tutors handle simple long-term models or based on heuristics to quantitatively estimate the knowledge measured. In this paper we propose a student knowledge diagnosis model which combines CBM with the Item Response Theory (IRT). IRT is a probabilistic and data-driven theory which guarantees accurate and invariant student knowledge estimations. By means of this synergy between CBM and IRT we suggest the construction of long-term student models composed of the estimations of their knowledge. This paper also includes an experiment we have carried out with real students, which explores the validity of the diagnoses made with our model.
منابع مشابه
Towards Efficient Item Calibration in Adaptive Testing
Reliable student models are vital for the correct functioning of Intelligent Tutoring Systems. This means that diagnosis tools used to update the student models must be also reliable. Through adaptive testing, student knowledge can be inferred. The tests are based on a psychometric theory, the Item Response Theory. In this theory, each question has a function assigned that is essential for dete...
متن کاملStudent Modeling Method Integrating Knowledge Tracing and IRT with Decay Effect
Educational data mining (EDM) involves the application of data mining, machine learning, and statistics to information generated from educational settings. Modeling students’ knowledge is a fundamental part of intelligent tutoring systems. One of the most popular methods for estimating students’ knowledge is knowledge tracing. It is the de-facto standard for inferring students’ knowledge from p...
متن کاملIntegrating Knowledge Tracing and Item Response Theory: A Tale of Two Frameworks
Traditionally, the assessment and learning science communities rely on different paradigms to model student performance. The assessment community uses Item Response Theory which allows modeling different student abilities and problem difficulties, while the learning science community uses Knowledge Tracing, which captures skill acquisition. These two paradigms are complementary – IRT cannot be ...
متن کاملA Bayesian Student Model without Hidden Nodes and its Comparison with Item Response Theory
The Bayesian framework offers a number of techniques for inferring an individual’s knowledge state from evidence of mastery of concepts or skills. A typical application where such a technique can be useful is Computer Adaptive Testing (CAT). A Bayesian modeling scheme, POKS, is proposed and compared to the traditional Item Response Theory (IRT), which has been the prevalent CAT approach for the...
متن کاملOn the Performance Characteristics of Latent-Factor and Knowledge Tracing Models
Modeling student knowledge is a fundamental task of an intelligent tutoring system. A popular approach for modeling the acquisition of knowledge is Bayesian Knowledge Tracing (BKT). Various extensions to the original BKT model have been proposed, among them two novel models that unify BKT and Item Response Theory (IRT). Latent Factor Knowledge Tracing (LFKT) and Feature Aware Student knowledge ...
متن کامل